Question Answering System for QA4MRE@CLEF 2012

The article presents the experiments carried out as part of the participation in the main task of QA4MRE@CLEF 2012. In the developed system, we first combine the question and each answer option to form the Hypothesis (H). Stop words are removed from each H and query words are identified to retrieve the most relevant sentences from the associated document using Lucene. Relevant sentences are retrieved from the associated document based on the TF-IDF of the matching query words along with n-gram overlap of the sentence with the H. Each retrieved sentence defines the Text T. Each T-H pair is assigned a ranking score that works on textual entailment principle. A validate weight is automatically assigned to each answer options based on their ranking. A parallel procedure also generates the possible answer patterns from given questions and answer options. Each sentence in the associated document is assigned an inference score with respect to each answer pattern. Evaluated inference score for each answer option is multiplied by the validate weight based on their ranking. The answer option that receives the highest selection score is identified as the most relevant option and selected as the answer to the given question.